Relevance Clues Developing an Experimental Design to Examine the Criteria Behind Relevance Judgments
نویسنده
چکیده
When users of information systems judge the relevance of search results, diverse criteria beyond topical relevance come into play. In this paper, we introduce the doctoral project Relevance Clues, which, through an experimental design, seeks to gain significant knowledge on the criteria by which users make relevance judgments.
منابع مشابه
Users' Relevance Criteria in Music Retrieval in Everyday Life: An Exploratory Study
The paper presents the findings of a qualitative study on the way young adults make relevance inferences about music items when searching for music for recreational purposes. Data were collected through in-depth interviews and analyzed following the constant comparative method. Content analysis revealed that participants used four types of clues to make relevance inferences: bibliographic metad...
متن کاملThe Development and Standardization of an Indian Positive Body Image Scale with an Exploratory Research Design
Background: Body image is an integral component of the self-concept that significantly shapes human functioning and people’s life outcomes. Although negative body image is well-studied, there is little research on positive body image. The study examined the basic characteristics of positive body image intending to standardize a scale for it. Methods: The study used using an exploratory resear...
متن کاملFaculty Relevance Criteria: Internalized User Needs
REFERENCE LIBRARIANS, ONLINE SEARCHERS, system designers, and other information professionals work to incorporate user-based relevance criteria into information services and systems. Genuinely utilizing the relevance criteria that patrons employ requires, as a first step, the development of an in-depth understanding of those criteria. This study progresses toward that understanding by providing...
متن کاملFrom Highly Relevant to Not Relevant: Examining Different Regions of Relevance
User relevance judgments are central to both the systems and user-oriented approaches to information retrieval (IR) systems research and development. User-oriented relevance research has also operated on two largely unconnected tracks. First, a relevance level track that examines users' criteria for relevance judgments. Second, a regions of relevance track that examines the measurement of users...
متن کاملOn the relationship between click rate and relevance for search engines
Evaluation of search engine result relevance has tradtionally been an expensive process done by human judges. Researchers have sought cheap automated proxies for such judgments. This paper examines the relationship between relative click rates (of two engines) and relative human judgments of result sets returned by those engines. Previous work has indicated that human judgments are more consist...
متن کامل